Vehicle having a projector for projecting an image on a road surface

ABSTRACT

Information related to a vehicle can be displayed by projecting an image based on the information on a road surface or the like. An image projection apparatus that projects an image includes: a sensor unit that acquires information related to a vehicle; and an image projection unit that projects the image based on the information acquired by the sensor unit.

TECHNICAL FIELD

The present invention relates to an image projection apparatus.

BACKGROUND ART

An image projection apparatus typified by a projector has already beenused in various fields as an apparatus for projecting a desired image inan enlarged manner, and it has been widely used as a display device fora personal computer and a cellular phone in recent years.

Regarding such an image projection apparatus, those listed below havealready been known as prior art techniques particularly related to theuse in a vehicle.

RELATED ART DOCUMENTS Patent Documents

-   Patent Document 1: Japanese Patent Application Laid-Open Publication    No. H08-43781-   Patent Document 2: Japanese Patent Application Laid-Open Publication    No. 2004-136838-   Patent Document 3: Japanese Patent Application Laid-Open Publication    No. 2010-26759-   Patent Document 4: Japanese Patent Application Laid-Open Publication    No. 2012-247369-   Patent Document 5: Japanese Patent Application Laid-Open Publication    No. 2014-153868

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

Namely, Patent Document 1 described above discloses a projection typedisplay apparatus which uses a vehicle headlight as an external lightsource by disposing an LCD projector, which incorporates no light sourceand is excellent in portability, in front of the vehicle headlight. InPatent Document 2, a first state in which the projector is incorporatedin front of the headlight in the vehicle in advance and a second statein which the projector or the headlight is moved to emit light flux fromthe headlight directly to the outside of the vehicle are realized forsolving a problem of Patent Document 1, and further an embodiment inwhich an image is displayed on a road is disclosed.

Also, an apparatus for vehicle driving support which, in order toeffectively arouse attention of a driver of a vehicle at the time ofdetermination of lane departure, displays information for promotingattention on a road ahead of a vehicle by irradiation means (laser)attached to a headlight part in front of the vehicle is known by PatentDocument 3.

In addition, an apparatus which is provided with a projector asprojection means attached at a front part of a vehicle and projects aroute guide image for guiding the vehicle in a branching direction basedon route information searched by a navigation system on a road surfaceahead of the vehicle, with a setting of a projection angle is alreadyknown by Patent Document 4. Further, an apparatus for vehicle drivingsupport which enables recognition of a place where a vehicle is headingby projecting a drawing pattern made up of target marks and trackinglines on a road surface ahead of the vehicle based on a traveling stateof the vehicle, and thus enables proper driving based thereon is alreadyknown by Patent Document 5.

A vehicle runs regardless of day or night, and surroundings of thevehicle are bright in the daytime and the front of the vehicle becomesbright by lighting of a headlight (HL) in the nighttime, so thatvisibility of an image projected on the road surface ahead of thevehicle may be degraded. In order to secure higher safety also forpedestrians walking near the vehicle, satisfactory visibility isrequired for the image projected on the road surface. However, theconventional techniques described above have not effectively performedprojection such that the projected image can be visually recognizedeasily when brightness outside the vehicle or the traveling statechanges.

Thus, the present invention has been made in view of the problems in theconventional techniques described above, and an object thereof is toprovide an image projection apparatus capable of displaying an image soas to be visually recognized easily by projecting the image on a roadsurface, wall surface, or the vehicle (hereinafter, road surface or thelike) based on vehicle information such as the brightness, the travelingstate, and the like of the vehicle (mobile body typified by automobileor the like).

Means for Solving the Problems

To solve the problems mentioned above, for example, a configurationdescribed in CLAIMS is adopted. The present application includes aplurality of means to solve the problems and an example thereof is animage projection apparatus that projects an image, and the imageprojection apparatus includes: a sensor unit that acquires informationrelated to a vehicle; and an image projection unit that projects theimage based on the information acquired by the sensor unit.

Effects of the Invention

According to the present invention, it is possible to project anddisplay an easily recognizable image on a road surface or the like basedon information related to a vehicle.

BRIEF DESCRIPTIONS OF THE DRAWINGS

FIGS. 1A and 1B are front perspective views of a vehicle which mounts animage projection apparatus according to an embodiment of the presentinvention and projects an image on a road surface or the like;

FIGS. 2A and 2B are rear perspective views of a vehicle which mounts theimage projection apparatus according to the embodiment of the presentinvention and projects an image on a road surface or the like;

FIG. 3 is a diagram illustrating an overall configuration of a lightcontrol ECU constituting the image projection apparatus;

FIG. 4 is a block diagram illustrating a further detailed configurationexample of the light control ECU and its peripheral elements;

FIG. 5 is a diagram illustrating an example of a configuration of theimage projection apparatus;

FIG. 6 is an explanatory diagram for a case of projecting an image on aroad surface in a state where a headlight is controlled in accordancewith vehicle speed;

FIGS. 7A and 7B are diagrams illustrating a control form of theheadlight and the image projection apparatus in accordance with thevehicle speed;

FIG. 8 is an operation flow diagram of the control forms of FIGS. 7A and7B;

FIGS. 9A and 9B are explanatory diagrams for a case of projecting animage on the road surface, while changing brightness of the image inaccordance with ON/OFF of the headlight;

FIG. 10 is a diagram illustrating an operation flow of FIGS. 9A and 9B;

FIGS. 11A and 11B are explanatory diagrams for a case of projecting animage on the road surface, while changing a display position of theimage in accordance with high/low of the headlight;

FIG. 12 is a diagram illustrating an operation flow of FIGS. 11A and11B;

FIGS. 13A and 13B are explanatory diagrams for a case of projecting animage on the road surface, while changing the brightness of the image inaccordance with day or night;

FIGS. 14A and 14B are explanatory diagrams for a case of projecting animage on the road surface, while changing the brightness of the image inaccordance with brightness outside the vehicle;

FIG. 15 is a diagram illustrating an operation flow of FIGS. 14A and14B;

FIG. 16 is a diagram illustrating an operation flow of projecting animage on the road surface, while changing the brightness of the image inaccordance with day or night (brightness outside the vehicle);

FIG. 17 is a diagram illustrating an operation flow of projecting animage on the road surface in accordance with the brightness outside thevehicle;

FIGS. 18A and 18B are diagrams for describing an irradiation region ofthe headlight and a projection region of an image by an image projectionapparatus according to another embodiment of the present invention;

FIGS. 19A and 19B are diagrams illustrating an example of a specificconfiguration for separately forming the projection region of the imagein the irradiation region of the headlight in the other embodimentdescribed above;

FIGS. 20A, 20B and 20C are diagrams illustrating an example of theprojection region of the image separately formed in the irradiationregion of the headlight by the configuration described above; and

FIG. 21 is a diagram illustrating another example of the specificconfiguration for separately forming the projection region of the imagein the irradiation region of the headlight in the other embodimentdescribed above.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Hereinafter, embodiments of the present invention will be described indetail with reference to the accompanying drawings.

<Arrangement of Image Projection Apparatus>

First, FIGS. 1A and 1B illustrate a passenger car as an example of avehicle 10 which mounts an image projection apparatus according to anembodiment of the present invention, and as illustrated in thesefigures, a pair of left and right headlights (HL) 11 is provided infront of a main body of the vehicle (passenger car) 10. In the exampleof FIG. 1A, although not illustrated in detail here, a lamp as a lightemitter is incorporated in each of the pair of headlights 11. Also, inthe example of FIG. 1A, two image projection apparatuses, that is, apair of left and right image projection apparatuses described in detailbelow are mounted in the vehicle (passenger car) 10. Then, two imagelights from the image projection apparatuses are projected onto a roadsurface ahead of the vehicle through, for example, a pair of left andright transparent window parts 13 a and 13 b.

14 a denotes a projection region projected from an image projectionapparatus through the window part 13 a on the right side of the vehicle,14 b denotes a projection region projected through the window part 13 bon the left side of the vehicle, 15 a denotes a projection drawing ofone part of an arrow projected in the projection region 14 a, and 15 bdenotes a projection drawing of the other part of the arrow projected inthe projection region 14 b. By synthesizing these two projectiondrawings, the arrow indicating that the vehicle turns to the right isprojected on a road surface ahead of the vehicle (passenger car) 10. Inthe example of FIG. 1A, the projection regions 14 a and 14 b areseparated horizontally, but the projection regions may be separatedvertically.

FIG. 1B illustrates an example in which only one image projectionapparatus is mounted on a front part of a vehicle body. In this case,image light from the image projection apparatus is projected onto a roadsurface ahead of the vehicle through, for example, a transparent windowpart 12 provided on the front part of the vehicle body. 16 denotes aprojection region projected from one image projection apparatus, and 17denotes a projection drawing illustrating an arrow projected in thisregion.

The above-described arrow image projected on the road surface or thelike indicates a current or subsequent traveling direction of thevehicle to a pedestrian or the like walking near the vehicle (passengercar) 10, thereby securing higher safety.

Next, FIGS. 2A and 2B each illustrate a rear side of the vehicle(passenger car) 10 that mounts one image projection apparatus accordingto the embodiment of the present invention, and red tail lamps 18 and18′ are provided on the rear side of the vehicle body. In the example ofFIG. 2A, although not illustrated in detail, a lamp as a light emitteris incorporated in each of these tail lamps 18 and 18′. Also, in theexample of FIG. 2A, two image projection apparatuses, that is, a pair ofleft and right image projection apparatuses are mounted, and an arrowindicating that the vehicle turns to the right while moving backward isprojected on the road surface behind the vehicle (passenger car) 10 bycombining image lights from the image projection apparatuses, forexample, two projection drawings through transparent window parts.

Also, FIG. 2B illustrates an example in which the image projectionapparatus is mounted near the roof of the vehicle body. In the exampleof FIG. 2B, similarly to the example of FIG. 1B, the image light of anarrow indicating that the vehicle turns to the right while movingbackward is projected on the road surface behind the vehicle (passengercar) 10 through a transparent window part provided on the rear end ofthe vehicle body.

In the foregoing, examples in which one or plural (for example, a pairof) image projection apparatuses are mounted on the front and back ofthe vehicle 10 have been described, but the present invention is notlimited to these, and the image projection apparatus may be mounted atany location of the vehicle 10 other than the front and back thereofsuch as a side mirror part, on the roof, side and bottom of the vehiclebody. Also, the image projection apparatus may be integrallyincorporated in the headlight or the tail lamp. Namely, in the presentinvention, the image projection apparatus may be mounted at any locationas long as a desired image can be projected on the road surface or thelike by the image projection apparatus. In a case where the imageprojection apparatus is integrally incorporated in the headlight or thetail lamp, a light source of the headlight or the tail lamp can be usedalso as a light source for projection.

<Configuration of Light Control ECU>

Subsequently, FIG. 3 illustrates an example of a configuration of anelectronic control unit (light control ECU) mounted in the vehicle 10described above. As apparent from the figure, a light control ECU 40includes a central processing unit (CPU) 41, RAM 42 and ROM 43 asstorage means, and an input/output device (I/O unit) 44. The lightcontrol ECU 40 receives information input from a various informationacquisition unit and a communication unit described below via the I/Ounit 44, and controls driving of the headlight 11 and image projectionof an image projection apparatus 500.

Note that the information from the various information acquisition unitincludes, for example, a speed signal indicating a traveling speed ofthe vehicle 10, a signal indicating an engine state (ON/OFF), gearinformation indicating a gear position, a hazard signal notifyingsurrounding drivers of existence of danger, a steering wheel anglesignal indicating a steering angle of a steering wheel, a turn-signalsignal indicating presence/absence of a turn signal (referred to also asa “blinker”) and which of the left and right is lighting/blinking, andfurther lamp lighting information indicating lighting/blinking states ofthe various lamps.

The information from the various information acquisition unit furtherincludes, for example, information from an external light sensor whichdetects light (brightness) outside the vehicle (illuminance signal,chromaticity signal, and the like), image information from a cameraattached to the vehicle, a signal from a distance sensor which detects adistance to another vehicle running around the vehicle 10 such as infront of it or other objects, and further a signal from an infraredsensor which detects a situation outside the vehicle in the nighttime.

In addition, the information from the communication unit includes, forexample, a GPS (Global Positioning System) signal for determining aposition of the vehicle 10, so-called navigation information that isinformation from a navigation device which performs route guidance andthe like, and further information of inter-vehicle communicationperformed with another vehicle and road-to-vehicle communicationperformed between the road and the vehicle.

FIG. 4 illustrates a further detailed configuration of the light controlECU 40 and its peripheral elements described above. Namely, signals froma direction indicator sensor 51, a steering wheel angle sensor 52, ashift position sensor 53, a vehicle speed sensor 54, an acceleratoroperation sensor 55, a brake operation sensor 56, an illuminance sensor57, a chromaticity sensor 58, an engine start sensor 59, and a hazardlamp sensor 60 are input to the light control ECU 40. Further, a signalfrom a camera 61 is input to the light control ECU 40 via an imageprocessing unit 62, and signals from a GPS receiving unit 63 and a mapinformation output unit 64 are input to the light control ECU 40 via acalculation unit 65.

Also, a projector 100 constituting the image projection apparatus 500receives a control signal input from the light control ECU 40 and asignal input from a projection signal output unit 110 (image signalprojected on the road surface or the like) via a control unit 120,whereby projection of an image onto the road surface or the likedescribed below is executed.

In addition, the light control ECU 40 further receives signals inputfrom a headlight sensor 66 indicating lighting and turning-off of theheadlight and brightness during lighting, and a signal input from ahigh/low sensor 67 indicating a high/low state of a light beam duringthe lighting of headlight. The sensor unit is configured of thesesensors 51 to 60, 66, and 67.

Further, brightness of the headlight 11 is controlled by the lightcontrol ECU 40 via a headlight control unit (HL control unit) 19.

<Image Projection Apparatus>

Subsequently, an example of a further detailed configuration of theimage projection apparatus 500 including the projector 100, theprojection signal output unit 110, and the control unit 120 illustratedin FIG. 4 will be described below with reference to FIG. 5.

A projection optical system 501 constituting the projector 100 is anoptical system for projecting an image onto the road surface or thelike, and includes a lens and/or a mirror. A display device 502 is adevice which generates an image by modulating transmitting light orreflecting light, and for example, a transmissive liquid crystal panel,a reflective liquid crystal panel, or a DMD (Digital Micromirror Device)panel (registered trademark) is used. A display device driving unit 503sends a driving signal to the display device 502, and causes the displaydevice 502 to generate an image. A light source 505 generates light forimage projection, and a high pressure mercury lamp, a xenon lamp, an LEDlight source, a laser light source, or the like is used. A power source506 supplies power to the light source 505. Further, the power source506 supplies necessary power to each of other units. An illuminationoptical system 504 collects and uniformizes the light generated by thelight source 505, and emits the light to the display device 502. Acooling unit 515 cools each part to be in a high temperature state suchas the light source 505, the power source 506, or the display device 502by an air cooling method or a liquid cooling method as necessary. Anoperation input unit 507 is an operation button or a light receivingunit of a remote controller, and receives an operation signal input froma user.

An image signal input unit 531 is connected to an external image outputdevice to receive image data input from the external image outputdevice. An audio signal input unit 533 is connected to an external audiooutput device to receive audio data input from the external audio outputdevice. An audio output unit 540 is capable of outputting audio based onthe audio data input to the audio signal input unit 533. Also, the audiooutput unit 540 may output an incorporated operation sound or errorwarning sound. A communication unit 532 is connected to, for example, anexternal information processing device to input and output variouscontrol signals.

A nonvolatile memory 508 stores various data to be used in a projectorfunction. The data stored in the nonvolatile memory 508 includes picturedata and image data prepared in advance for the projection onto theroad. A memory 509 stores the image data to be projected and controlparameters of each unit of the apparatus. A control unit 510 controlsoperation of each of connected units.

An image adjustment unit 560 performs image processing to the image datainput by the image signal input unit 531 and the picture data and theimage data stored in the nonvolatile memory 508. The image processingincludes, for example, scaling processing that performs enlargement,reduction, and deformation of the image, brightness adjustmentprocessing that changes brightness, contrast adjustment processing thatchanges a contrast curve of the image, and retinex processing thatdecomposes the image into light components and changes weighting foreach component.

A storage unit 570 records the image, picture, audio, and various data.For example, the image, picture, audio, and various data may be recordedin advance at the time of product shipment, or the image, picture,audio, and various data acquired from an external device, an externalserver, or the like via the communication unit 532 may be recorded. Theimage, picture, various data and the like recorded in the storage unit570 may be output as a projection image via the display device 502 andthe projection optical system 501. The audio recorded in the storageunit 570 may be output as audio from the audio output unit 540.

As described above, the image projection apparatus 500 can mount variousfunctions. However, the image projection apparatus 500 does notnecessarily have to include all the configurations described above. Theimage projection apparatus 500 may have any configuration as long as ithas a function of projecting the image.

FIG. 6 is a ray diagram of a projector 100 including an image plane. Inthis figure, the image light, which is emitted from the light sourceconstituted of an LED or the like (not illustrated) and transmitsthrough the image display device, passes through a filter and the like,is refracted by various lens systems, and is further reflected inaccordance with the configuration, and is then projected on an imageplane 8 (road surface or the like).

In this manner, in the image projection apparatus 500 described above,the length of the long side of the range of the projection image is10061−542=9519≈9520 mm with respect to the projection distance of 700mm, and thus an unprecedented wide angle of view with the projectionratio of 700/9520≈0.07 is realized.

Then, since the vehicle 10 runs in the nighttime while lighting theheadlight 11, light beam from the headlight 11 is emitted on the imageplane (road surface or the like) 8. Accordingly, on the image plane(road surface or the like) 8 in the nighttime, the projection image fromthe image projection apparatus 500 and the light beam from the headlight11 are emitted in an overlapped manner.

In the foregoing, one image projection apparatus 500 and the projectionoptical system thereof have been described, but one or plural (forexample, a pair of) projectors may be mounted on the vehicle (orintegrally incorporated in the headlights or tail lamps) in the presentinvention as described above such that a desired image is projected onthe road surface or the like. At that time, in a case of the plural (forexample, the pair of) image projection apparatuses 500 as illustrated inFIG. 1A and FIG. 2A in particular, the same image may be projected onthe road surface or the like from each of the image projectionapparatuses 500 (in this case, the same image is displayed on thedisplay device 502 of FIG. 5), or different images may be projected fromthe left and right image projection apparatuses 500 and synthesizedtogether on the road surface or the like (in this case, an imageobtained by dividing the desired image into left and right is displayedon the display device 502 of FIG. 5).

In the foregoing, as the image projection apparatus 500 that projectsthe image on the road surface or the like, the configuration using thetransmissive liquid crystal image display device has been described, butthe present invention is not limited to this. For example, a reflectiveimage projection apparatus 500 constituted of a micromirror such as aDLP (Digital Light Processing) apparatus and an image projectionapparatus 500 capable of projecting image light from a light modulableplanar light emitting diode via the projection optical system can alsobe used as the image projection apparatus 500 in addition to thatdescribed above. Namely, in the present invention, any image projectionapparatus 500 may be used as long as the desired image can be projectedon the road surface or the like by the image projection apparatus 500.

<Control of Projection Image onto Road Surface or the Like>

Subsequently, specific examples of various images projected on the roadsurface or the like based on a relationship with vehicle information inthe configuration in which the above-described headlight and imageprojection apparatus 500 are mounted on the front side and/or the rearside of the vehicle in the above-described manner will be described indetail with reference to FIGS. 7 to 17. Note that, in the embodimentdescribed below, an arrow is used as an example of the image projectedfrom the image projection apparatus 500, but the image is not limited tothis, and may be a shape indicating a direction, character information,or the like.

FIGS. 7A and 7B illustrate control forms of light of the headlight andan arrow image of the image projection apparatus 500 projected on theroad surface ahead of the vehicle 10 at the time of deceleration duringtraveling of the vehicle in the nighttime. 21 denotes a projectionregion of the headlight projected on the road surface, 22 denotes aprojection region projected by the image projection apparatus 500, and23 denotes an arrow image projected in the projection region 22. Thelight of the headlight and the arrow image of the image projectionapparatus 500 are projected in the projection region 22 in an overlappedmanner.

At a normal speed, based on the signal from the vehicle speed sensor 54illustrated in FIG. 4, the headlight emits light on the road surfacewith normal brightness, and the image projection apparatus 500 projectsthe arrow image 23 on the road surface with normal brightness (FIG. 7A).When the vehicle decelerates or stops, based on the signal of thevehicle speed sensor 54, the headlight emits light dimmer than usual onthe road surface within a range stipulated by laws and regulations, andthe image projection apparatus 500 projects the arrow image 23 on theroad surface with the same brightness as the above FIG. 7B.

Note that the control of brightness in the image projection apparatus500 can be performed by a brightness adjustment processing function ofthe image adjustment unit 560. Also, the control may be performed by thenumber of LEDs to be lit or pulse width modulation in the configurationincluding a plurality of LEDs as a light source. By performing thecontrol in this way, the image of the image projection apparatus 500 isemphasized at the time of deceleration or stop of the vehicle, and it isthus possible to arouse people's attention, reliably present (warn) thecurrent or subsequent traveling direction of the vehicle to surroundingdrivers and pedestrians, and secure higher safety.

In the examples illustrated in FIGS. 7A and 7B, the headlight is dimmedwithout changing brightness of the image from the image projectionapparatus 500, but the present invention is not limited to this, and thebrightness of the image from the image projection apparatus 500 may beincreased without changing the brightness of the headlight or thebrightness of the headlight may be decreased while increasing thebrightness of the image from the image projection apparatus 500. Namely,if control to make the brightness of the image from the image projectionapparatus 500 relatively higher than the headlight is performed at thetime of deceleration or stop of the vehicle, it is possible to securehigher safety similarly to the above.

Note that the examples illustrated in FIGS. 7A and 7B are effective in acase where it is difficult to change the brightness of the image fromthe image projection apparatus 500.

FIG. 8 schematically illustrates an operation flow of the control formof FIGS. 7A and 7B. When the light control ECU 40 detects decelerationor stop of the vehicle 10 in step 201 based on the speed signal from thevehicle speed sensor 54 received in step 200, the brightness of theimage projection apparatus 500 is controlled in step 202, and thebrightness of the headlight is controlled in step 203. The control ofbrightness in the image projection apparatus 500 is performed by thecontrol unit 510 illustrated in FIG. 5, and the control of brightness inthe headlight is performed by the headlight control unit (HL controlunit) 19.

In the image projection from the image projection apparatus 500 at thetime of backward movement of the vehicle 10 illustrated in FIGS. 2A and2B, the control form illustrated in FIGS. 7A, 7B and 8 are appliedbecause the vehicle 10 moves backward while decelerating. In this case,brightness of a reversing light (backlight) is controlled instead of theheadlight.

FIGS. 9A and 9B illustrate control forms of the light of the headlightprojected on the road surface ahead of the vehicle 10 and the arrowimage from the image projection apparatus 500 at the time of lighting orturning-off of the headlight in the twilight or the nighttime. 25denotes a headlight projection region projected on the road surface, 26denotes a projection region projected by the image projection apparatus500, and 27 denotes an arrow image projected in the projection region26. The light of the headlight and the arrow image of the imageprojection apparatus 500 are projected in the projection region 26 in anoverlapped manner.

Based on input of the signal indicating lighting or turning-off from theheadlight sensor 66 illustrated in FIG. 4, the arrow image 27 isprojected on the road surface with normal brightness from the imageprojection apparatus 500 during turning-off of the headlight (FIG. 9A).Then, during lighting of the headlight, the arrow image 27 is projectedfrom the image projection apparatus 500 with a higher brightness thanthe normal brightness on the road surface on which the light of theheadlight is emitted FIG. 9B.

Normally, since the front of the vehicle becomes bright by the lightingof the headlight (HL), visibility of the image projected on the roadsurface ahead of the vehicle from the image projection apparatus 500 isdegraded. However, by performing the control illustrated in FIGS. 9A and9B, the reduction of visibility of the arrow image from the imageprojection apparatus 500 can be prevented by the increase of thebrightness even when the headlight is lit. Accordingly, since the arrowimage is emphasized even when the headlight (HL) is lit, it is possibleto arouse people's attention, reliably present (warn) the travelingdirection of the vehicle 10 to surrounding drivers and pedestrians, andsecure higher safety.

FIG. 10 schematically illustrates an operation flow of the control formsof FIGS. 9A and 9B. The lighting (ON) signal or the turning-off (OFF)signal is output from the headlight sensor 66 in step 204, the lightcontrol ECU 40 detects the signal in step 205, and the control isperformed to increase brightness from the image projection apparatus 500in step 206. Note that the control of brightness of the image projectionapparatus 500 can be performed by a brightness adjustment processingfunction of the image adjustment unit 560. Also, the control may beperformed by the number of LEDs to be lit or pulse width modulation inthe configuration including a plurality of LEDs as a light source.

FIGS. 11A and 11B illustrate a high/low state of the light of theheadlight projected on the road surface ahead of the vehicle 10 and acontrol form of a projection position of the arrow image from the imageprojection apparatus 500 in the vehicle traveling in the nighttime. InFIGS. 11A and 11B, a projection region of the image projection apparatus500 is illustrated, and the projection region may be matched with aprojection region of the headlight.

In this control form, the projection position of the arrow image fromthe image projection apparatus 500 is changed in accordance with thehigh/low state of the light beam during the lighting of the headlightfrom the high/low sensor 67 illustrated in FIG. 4. Namely, in the highbeam state, an arrow image 28 from the image projection apparatus 500 isprojected on a road surface far from the vehicle 10 (FIG. 11A), and inthe low beam state, the arrow image 28 from the image projectionapparatus 500 is projected on a road surface near the vehicle 10 (FIG.11B). Also, when the projection position is farther away, since aviewing angle from the driver becomes small, the image may also bechanged in addition to the projection position.

Specific control for changing the projection position of the arrow imagefrom the image projection apparatus 500 includes a case of controllingthe light source 505 in FIG. 5, a case of controlling the projectionoptical system 501, and a case of changing a used portion of a liquidcrystal panel of the display device 502.

In the case of controlling the light source 505, the projection positionis changed by changing positions of the LEDs to be lit in theconfiguration including a plurality of LEDs as a light source. Namely,an irradiation direction of the arrow image from the projection opticalsystem 501 is changed by changing the positions of the LEDs to be lit,so that the projection position of the arrow image on the road surfaceis changed.

In the case of controlling the projection optical system 501, theirradiation direction of the arrow image is changed by mechanicallychanging the optical axis of the projection optical system 501, so thatthe projection position of the arrow image on the road surface ischanged.

In the case of changing the used portion of the liquid crystal panel ofthe display device 502, when the light control ECU 40 detects a highbeam signal, it controls the image projection apparatus 500, and thedisplay device driving unit 503 in the image projection apparatus 500sends the driving signal to the display device 502 to generate the imagewhile changing the used portion of the liquid crystal panel of thedisplay device 502 such that the image is projected on the road surfacefar from the vehicle. Similarly, when the light control ECU 40 detects alow beam signal, the display device driving unit 503 in the imageprojection apparatus 500 sends the driving signal to the display device502 to generate the image while changing the used portion of the liquidcrystal panel of the display device 502 such that the image is projectedon the road surface near the vehicle.

FIG. 12 schematically illustrates an operation flow of the control formsof FIGS. 11A and 11B. When a high or low signal is output from thehigh/low sensor 67 in step 207, the light control ECU 40 detects thesignal in step 208, and controls the projection (display) position ofthe arrow image of the image projection apparatus 500 in accordance witheach signal in step 209.

The projection position may be changed in accordance with a combinationof the high/low signal of the headlight and the vehicle speed. Forexample, the projection position is controlled so as to project theimage at a short distance during low-speed driving in the low beam stateof the headlight, at a medium distance during medium-speed driving inthe high beam state of the headlight, and at a long distance duringhigh-speed driving.

Normally, the headlight is in the high beam state in a case where thereare no oncoming vehicles or people during traveling of the vehicle, andthe headlight is in the low beam state to prevent dazzling in a casewhere there are oncoming vehicles and people. According to this controlform, since the arrow image from the image projection apparatus 500 isprojected on the road surface near the vehicle when there are othervehicles and people near the vehicle, the arrow image is emphasized, andit is thus possible to arouse people's attention, reliably present(warn) the traveling direction of the vehicle to surrounding drivers andpedestrians, and secure higher safety.

In addition, the driver of the vehicle 10 directs his/her line of sightto a place near the vehicle 10 in the low beam state of the headlight,and moves his/her line of sight to a distant place in the high beamstate. According to the light control described above, since the arrowimage from the image projection apparatus 500 is projected in adirection of the line of sight of the driver of the vehicle 10,attention of the driver of the vehicle 10 is also aroused, and it isthus possible to secure higher safety.

FIG. 13 illustrates a control form of changing the brightness of theimage from the image projection apparatus 500 in accordance withbrightness of day or night. 29 and 30 respectively denote arrow imagesfrom the image projection apparatus 500 in the daytime and thenighttime, and 31 denotes an image of a projection region around thearrow image.

In the daytime, brightness of the arrow image 29 from the imageprojection apparatus 500 is increased, and brightness of the image 31around the arrow image 29 is decreased (FIG. 13A). On the other hand, inthe nighttime, brightness of the arrow image 30 is decreased, andbrightness of the image 31 around the arrow image 30 is increased (FIG.13B).

FIGS. 14A and 14B illustrate control forms of changing the brightness ofthe image from the image projection apparatus 500 in accordance withbrightness outside the vehicle. 32 and 33 respectively denote arrowimages from the image projection apparatus 500 when the outside isbright and dark, and 31 denotes an image of a projection region aroundthe arrow image.

Based on a brightness signal from the illuminance sensor 57 illustratedin FIG. 4, when the outside of the vehicle is bright, brightness of thearrow image 32 from the image projection apparatus 500 is increased (forexample, colored), and brightness of the image 31 around the arrow imageis decreased (FIG. 14A). On the other hand, when the outside of thevehicle is dark (at night or in a tunnel), brightness of the arrow image33 is decreased (for example, outline), and brightness of the image 31around the arrow image is increased (FIG. 14B).

According to the control forms illustrated in FIGS. 13A to 14B describedabove, since brightness of the arrow image is increased when the outsideis bright, it becomes easy to visually recognize the arrow image, and itis thus possible to reliably perform presentation (warning) tosurrounding drivers and pedestrians and secure higher safety. On theother hand, since it is easy to visually recognize the arrow image whenthe outside is dark, it is possible to brighten the surroundings bydecreasing the brightness of the arrow image and increasing thebrightness around the arrow image, and it is thus possible to reliablyperform presentation (warning) to surrounding drivers and pedestriansand secure higher safety by brightening the surroundings.

In particular, according to the projection image onto the road surfaceor the like of FIGS. 14A and 14B, it is easy for the surrounding driversand pedestrians to recognize the traveling direction of the vehicle 10,and when the arrow image is projected based on a signal from navigationinformation, it is easy also for the driver of the vehicle 10 torecognize a route to which the vehicle 10 should enter at theintersection, and it is thus possible to secure higher safety. Note thatsizes and colors of the arrow and the like may be varied in accordancewith the weather, time zone, or ambient brightness.

FIG. 15 schematically illustrates the control of FIGS. 14A and 14B. Thebrightness outside the vehicle is detected by the illuminance sensor 57in step 210, and a detection signal of the illuminance sensor 57 isinput to the light control ECU 40 in step 211. Then, in step 212, thelight control ECU 40 controls the image projection apparatus 500 basedon the brightness detection signal, and controls the brightness of thearrow image and the brightness around the arrow image.

FIG. 16 illustrates an operation flow of switching the light source ofthe image projection apparatus 500 between a high brightness lightsource and a normal light source in accordance with day or night (FIGS.13A and 13B) or the brightness outside the vehicle (FIGS. 14A and 14B).

The image projection apparatus 500 is started in step 213, ambient lightis detected by the illuminance sensor in step 214, and day or night isdetermined in step 215. In the case where it is in the daytime, the highbrightness light source is driven in the image projection apparatus 500in step 216, and in the case where it is not in the daytime, the normallight source with lower brightness is driven in the image projectionapparatus 500 in step 217.

Here, a laser light source is used as the high brightness light source,and an LED light source is used as the normal light source. Namely, twotypes of light sources such as the laser light source (first lightsource) and the LED light source (second light source) are provided asthe light source 505 in FIG. 5, and a necessary brightness can beobtained by selecting the light source to be driven depending on thenight or day or the brightness outside the vehicle. Since the pupilopens when it is in the nighttime or the surroundings are dark, the LEDlight source is preferably used.

Since the laser light as the high brightness light source is parallellight with excellent directivity and thus does not diffuse duringprojection, the brightness is less likely to decrease along the way, andit is possible to display the arrow image with high brightness on theroad surface. A laser scanning type that displays the arrow part bylaser scanning is used for the laser light source. When the laser lightis used in this way, the arrow image can be displayed on the roadsurface with the brightness having high visibility even in a case wherethe outside of the vehicle is bright, and it is thus possible toreliably perform presentation (warning) to the surrounding drivers andpedestrians and secure higher safety.

In addition, it is also possible to obtain a necessary high brightnessby providing a plurality of LEDs as the high brightness light source andindividually lighting the LEDs. Namely, in the case of the normal lowbrightness light source, a small number of LEDs are lit, and in the caseof the high brightness light source, a large number of LEDs are lit. Inthis case, since the brightness can be changed in multiple stages bychanging the number of LEDs to be lit, for example, if irradiation isperformed with the minimum brightness capable of maintaining a highvisibility state depending on a degree of brightness (illuminance)outside the vehicle, the high brightness light source can be driven withenergy saving.

The control forms of FIGS. 13A to 16 are adaptable to the imageprojection of the image projection apparatus 500 at the time of backwardmovement of the vehicle illustrated in FIGS. 2A and 2B. According to theprojection image onto the road surface or the like of such controlforms, it is possible to reliably perform presentation (warning) tosurrounding drivers and pedestrians and secure higher safetyparticularly in a case of parking in a garage.

FIG. 17 illustrates an operation flow of determining whether to performprojection of the image projection apparatus 500 in accordance with thebrightness outside the vehicle (FIGS. 14A and 14B). After the imageprojection apparatus 500 is started in step 218, ambient light outsidethe vehicle is detected by the illuminance sensor 57 in step 219. Then,it is determined in step 220 whether the projection image (arrow) of theimage projection apparatus 500 can have a sufficient contrast to theambient light detected by the light control ECU 40.

If the projection image can have the sufficient contrast, the arrowimage projected on the road surface can be visually recognized easily,and it is possible to reliably perform presentation (warning) tosurrounding drivers and pedestrians and secure higher safety. However,if the projection image cannot have the sufficient contrast, since it isdifficult for the surrounding drivers and pedestrians to visuallyrecognize the arrow image projected on the road surface and safetycannot be secured, it is useless to perform the projection from theimage projection apparatus 500.

Accordingly, when it is determined that the sufficient contrast can beobtained in step 220, a projection command is output from the lightcontrol ECU 40 to the image projection apparatus 500 in step 221. On theother hand, when it is determined that the sufficient contrast cannot beobtained in step 220, the projection command is not output from thelight control ECU 40 to the image projection apparatus 500 in step 222.At this time, a message stating that no projection command is output isdisplayed for the driver.

<Separation of Irradiation/Display Regions by Headlight and ImageProjection Apparatus>

In the above embodiment, the image displayed on the road surface fromthe image projection apparatus has been described as being projectedmainly in the irradiation region by the headlight of the vehicle duringtraveling in the nighttime or in the tunnel, but the present inventionis not limited to the above embodiment. Namely, in a case where thedisplay region by the image projection apparatus according to thepresent invention overlaps with the irradiation region by the headlight,it is considered that the contrast of the image projected on the roadsurface from the image projection apparatus is decreased due toirradiation light by the headlight, and visibility of the image isdegraded (deteriorated). Therefore, in the present invention, theproblem described above is solved by a so-called display region formingunit, which is arranged in the headlight 11 and separates (divides) theirradiation region by the headlight and the projection region by theimage projection apparatus from each other, and details of itsembodiment will be described below.

FIGS. 18A and 18B illustrate states in which the irradiation region bythe headlight and the display region by the image projection apparatusare separated from each other by the display region forming unitaccording to this embodiment. In particular, FIG. 18A illustrates a casewhere the display region by the image projection apparatus is set in arelatively close region 310 ahead of the vehicle (for Example, a rangefrom 0 m to 10 m ahead of the vehicle: hereinafter referred to as a“near region”) with respect to an irradiation region 300 by theheadlight ahead of the vehicle 10, and FIG. 18B illustrates a case wherethe display region by the image projection apparatus is set in arelatively far region 320 ahead of the vehicle (for example, a rangefrom 10 m to 20 m ahead of the vehicle: hereinafter referred to as a“far region”) with respect to the irradiation region 300.

More specifically, in FIG. 18A, in the region 300 (normally, a rangefrom 0 m to 40 ahead of the vehicle) irradiated by the light from theheadlight, illumination light that corresponds to a part of light of theheadlight and reaches the near region is blocked, so that the region 310where the illumination light from the headlight is blocked (=nearregion) is set as the display region and the projection image by theimage projection apparatus is displayed in the near region 310. On theother hand, in FIG. 18B, in the irradiation region 300 of the headlight,the illumination light that reaches the far region is blocked, so thatthe region 320 where the illumination light from the headlight isblocked (=far region) is set as the display region and the projectionimage by the image projection apparatus is displayed in the far region320. Note that the display regions of the projection image by the imageprojection apparatus, that is, the near region 310 and the far region320 do not exceed the irradiation region 300 by the headlight.

Then, if the image (in this example, the arrow to indicate the travelingdirection of the vehicle 10) by the image projection apparatus describedabove (see reference 500 of FIGS. 3 to 5) is projected in the nearregion 310 or the far region 320 formed in the above-described manner,reduction of the contrast of the projected image is eliminated, and thevisibility of the projection image is improved particularly duringlighting of the headlight, so that it is possible to reliably performpresentation (warning) to surrounding drivers and pedestrians and securehigher safety. At this time, it is most preferable that the imageincluding the arrow is displayed by, for example, a black-out image on awhite background because the projection light from the image projectionapparatus can be used as a part of the irradiation light from theheadlight and illumination efficiency can be improved. Note that theblack-out image on a white background mentioned here means that an imageportion to be projected is formed with color light with excellentdiscrimination, and light color in a region other than the image portionis formed with white light.

Next, a specific configuration of the display region forming unit withwhich the above-described near region 310 or far region 320 which is animage display region for displaying the image from the image projectionapparatus is formed in the irradiation region 300 by the headlight bychanging the irradiation region of the irradiation light from theheadlight will be described in detail below with reference to FIGS. 19Ato 20C.

First, FIGS. 19A and 19B illustrate configurations in which theabove-described near region 310 or far region 320 is formed by blockinga part of the light emitted from the headlight (see reference 11 of FIG.3 or 4) by the use of a so-called shade. In particular, FIG. 19A is across section illustrating the overall configuration of the headlightincluding the light-blocking configuration, and FIG. 19B is a partialperspective view illustrating the overall configuration of the headlightcentered on the light-blocking configuration.

In FIG. 19A, a light source 112 made up of, for example, an LED isarranged on a base plate 111, and a reflection plate 113 for collectingthe light emitted from the light source 112 and converting the lightinto emission light from a predetermined position (for example, a mirrorhaving a hemispherical reflection surface obtained by rotating anellipse) is attached around the light source 112. Further, the lightcollected by the reflection plate 113 is condensed by an optical device114 such as a lens and emitted forward from a glass front surface of theheadlight 11. Further, a shade 115 which is means of forming the nearregion 310 or the far region 320 by blocking a part of the light emittedfrom the headlight 11 is provided in the course of the optical pathtoward the optical device 114.

As illustrated also in FIG. 19B, the shade 115 is configured of aplurality of (in this example, three) plate members (blades) 115-1,115-2, and 115-3 rotatably attached around a common rotation shaft 116,and the plate members are set at respective angular positions byrotation means such as a motor (not illustrated) in this case. Namely,if a part of the light from the light source 112 is blocked by each ofthe three blades 115-1, 115-2, and 115-3, in other words, the light isemitted toward the front of the headlight 11 through the optical device114 such as the lens after passing through a shade opening formed by thecombination of the three blades 115-1, 115-2, and 115-3, it is possibleto obtain the illumination light that irradiates the predeterminedregion 300 and includes the desired image display region 310 or 320 asillustrated in FIGS. 20A to 20C.

Alternatively, instead of the above, for example, if the headlight 11with a configuration in which light from a planar light source 117formed by arranging a plurality of LEDs in an array on a surface isemitted toward the front of the headlight 11 through the optical device114 such as the lens as illustrated in FIG. 21 is used, it is possibleto obtain the illumination light that irradiates the predeterminedregion 300 and includes the desired image display region 310 or 320similarly to FIG. 20A to FIG. 20C by controlling the lighting of a partof the plurality of LEDs constituting the planar light source 117.

According to the embodiment described in detail above, since the imagedisplay region 310 or 320 for projecting the image from the imageprojection apparatus is separately formed as appropriate in theirradiation region 300 formed ahead of the headlight 11, the displayregion by the image projection apparatus does not overlap with theirradiation region by the headlight. For that reason, the contrast ofthe projection image is not decreased and its visibility is not degraded(deteriorated), so that it is possible to reliably perform presentation(warning) to surrounding drivers and pedestrians and secure highersafety even at the time of the lighting of the headlight.

Note that, in the embodiment above, the case in which the separation ofthe irradiation region 300 by the headlight 11 and the image displayregion 310 or 320 is performed when the image from the image projectionapparatus is projected has been described. However, the presentinvention is not limited to this, and the separation may be performed atall times. Also, regarding a boundary region between the headlight andthe image display region 310 or 320 in which the image from the imageprojection apparatus is projected, if these are overlapped (superposed)with each other or superposed by adding a gradation, the junction(joint) therebetween can be made less noticeable. Note that thegradation may be added to only one of the image display region projectedfrom the image projection apparatus and the irradiation regionirradiated from the headlight. In this manner, it is possible to reducediscomfort of the driver during driving and secure higher safety.

Further, in the above embodiment, the arrow for indicating the travelingdirection of the vehicle has been described as an example of the imageprojected in the image display region 310 or 320 by the image projectionapparatus. However, the present invention is not limited to this, andcan be applied to a case of displaying another image. Also, in the aboveembodiment, the region obtained by the so-called high beam has beendescribed as the irradiation region 300 irradiated ahead of theheadlight 11. However, the present invention is not limited to this, andthe illumination light including the desired image display region 310 or320 can be obtained for the region obtained by the low beam in the samemanner as described above. Note that it is also possible to apply thepresent invention to the light (for example, backlight or the like)other than the headlight.

REFERENCE SIGNS LIST

-   -   10 vehicle (passenger car)    -   11 headlight    -   12, 13 a, 13 b window part    -   14 a, 14 b, 16 projection region    -   15 a, 15 b, 17 projection drawing    -   18, 18′ tail lamp    -   19 headlight control unit    -   21 projection region of headlight    -   22 projection region of image projection apparatus    -   23 arrow image    -   40 light control ECU    -   51 direction indicator sensor    -   52 steering wheel angle sensor    -   53 shift position sensor    -   54 vehicle speed sensor    -   55 accelerator operation sensor    -   56 brake operation sensor    -   57 illuminance sensor    -   58 chromaticity sensor    -   59 engine start sensor    -   60 hazard lamp sensor    -   61 camera    -   62 image processing unit    -   63 GPS receiving unit    -   64 map information output unit    -   66 headlight sensor    -   67 high/low sensor    -   100 projector    -   110 projection signal output unit    -   120 control unit    -   500 image projection apparatus    -   501 projection optical system    -   502 display device    -   503 display device driving unit    -   504 illumination optical system    -   505 light source    -   531 image signal input unit    -   533 audio signal input unit    -   532 communication unit

The invention claimed is:
 1. A vehicle having a projector for projectingan image on a road surface, the vehicle comprising: a body; one or moresensors that acquire information related to the vehicle; an externallight sensor that detects light brightness outside the vehicle; aprojector having at least one first light source that projects an imagein front of the vehicle; and a controller communicatively coupled toheadlights of the vehicle, the one or more sensors, the external lightsensor, and the projector, the headlights each having at least onesecond light source, wherein the controller is configured to control arelative brightness of the image projected by the at least one firstlight source of the projector with respect to a brightness of lightemitted by the at least one second light source of the headlights of thevehicle based on the light brightness detected by the external sensor,wherein the image is projected by the projector within a projectionregion of the headlights of the vehicle, and wherein the at least onefirst light source of the projector and the at least one second lightsource of the projector are provided separately.
 2. The vehicleaccording to claim 1, wherein the one or more sensors include a vehiclespeed sensor that detects vehicle speed, and the controller furthercontrols the brightness of the image based on the vehicle speeddetected.
 3. The vehicle according to claim 1, wherein the one or moresensors include a headlight sensor that acquires information related tothe brightness of the light emitted by the at least one second lightsource of the headlights of the vehicle, and the controller furthercontrols the brightness of the image based on the headlight sensorinformation.
 4. The vehicle according to claim 1, wherein the controllerfurther controls the brightness the light emitted by the at least onesecond light source of the headlights based on the information acquiredby the one or more sensors and the external light sensor.
 5. A vehiclehaving a projector for projecting an image on a road surface, thevehicle comprising: a body; one or more sensors that acquire informationrelated to the vehicle; an external light sensor that detects lightbrightness outside the vehicle; a projector having at least one firstlight source that projects an image in front of the vehicle; and acontroller communicatively coupled to headlights of the vehicle, the oneor more sensors, the external light sensor, and the projector, theheadlights each having at least one second light source, wherein thecontroller is configured to: control the at least one second lightsource of the headlights of the vehicle to limit an illumination regionof an illumination light of the vehicle in order that a brightness ofthe image projected by the at least one first light source becomesrelatively high with respect to the illumination light of the vehiclebased on the external light sensor; control a shade member that blocks apart of the illumination light from the headlights, thereby separatelyforming a display region within a projection region of the headlights ofthe vehicle; and control the projector to project the image in thedisplay region, and wherein the at least one first light source of theprojector and the at least one second light source of the projector areprovided separately.
 6. The vehicle according to claim 5, wherein thecontroller controls the shade member to selectively form the displayregion in a near region ahead of the vehicle or in a far region fartherthan the near region by controlling the headlights.
 7. The vehicleaccording to claim 5, wherein the projector displays the image to beprojected by a black-out image on a white background.
 8. The vehicleaccording to claim 5, wherein the controller controls a shape of theshade member to form the display region.
 9. The vehicle according toclaim 5, wherein a boundary portion between the display region of theillumination light and the projection region of the headlights is formedby overlapping both of the regions with each other.